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Background. The structure and organisation of ecological interactions within an 
ecosystem is modified by the evolution and coevolution of the individual species 
it contains. Understanding how historical conditions have shaped this architecture 
is vital for understanding system responses to change at scales from the microbial 
upwards. However, in the absence of a group selection process, the collective be¬ 
haviours and ecosystem functions exhibited by the whole community cannot be 
organised or adapted in a Darwinian sense. A long-standing open question thus 
persists: Are there alternative organising principles that enable us to understand 
and predict how the coevolution of the component species creates and maintains 
complex collective behaviours exhibited by the ecosystem as a whole? 

Results. Here we answer this question by incorporating principles from connec- 
tionist learning, a previously unrelated discipline already using well-developed 
theories on how emergent behaviours arise in simple networks. Specifically, we 
show conditions where natural selection on ecological interactions is functionally 
equivalent to a simple type of connectionist learning, ‘unsupervised learning’, well- 
known in neural-network models of cognitive systems to produce many non-trivial 
collective behaviours. Accordingly, we find that a community can self-organise 
in a well-defined and non-trivial sense without selection at the community level; 
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its organisation can be conditioned by past experience in the same sense as con- 
nectionist learning models habituate to stimuli. This conditioning drives the com¬ 
munity to form a distributed ecological memory of multiple past states, causing 
the community to: a) converge to these states from any random initial composi¬ 
tion; b) accurately restore historical compositions from small fragments; c) recover 
a state composition following disturbance; and d) to correctly classify ambigu¬ 
ous initial compositions according to their similarity to learned compositions. We 
examine how the formation of alternative stable states alters the community’s re¬ 
sponse to changing environmental forcing, and we identify conditions under which 
the ecosystem exhibits hysteresis with potential for catastrophic regime shifts. 
Conclusions. This work highlights the potential of connectionist theory to ex¬ 
pand our understanding of evo-eco dynamics and collective ecological behaviours. 
Within this framework we find that, despite not being a Darwinian unit, ecological 
communities can behave like connectionist learning systems, creating internal con¬ 
ditions that habituate to past environmental conditions and actively recalling those 
conditions. 

Keywords, evolutionary ecology, alternative stable states, Lotka-Volterra dynam¬ 
ics, theoretical ecology, community assembly, network structures, ecological mem¬ 
ory, associative learning, regime shifts, community matrix 


Background 

With ever-increasing anthropogenic pressure on natural systems, it is vital to understand how 
the ecosystems we depend upon have been conditioned by evolutionary processes in historical 
environments which may have been very different from those they experience in the present 
day, and how any such conditioning may shape these systems’ responses to new pressures. 
However, as ecosystems are not typically units of selection, we currently lack a framework 
linking adaptive pressures on individuals and populations to the dynamical properties of the 
systems they inhabit. In this article we investigate how systems above the Darwinian levels 
of selection may evolve collective behaviours, and observe a deep homology with emergent 
properties well understood in connectionist models of machine learning. We use this homology 
to develop theoretical analysis of emergent properties of natural selection in ecosystems, and 
explore the implications for community dynamics through Lotka-Volterra simulation. 


Connections and collective behaviours in ecosystems 

The structure and organisation of ecological interactions within biological communities causes 
them to exhibit many complex behaviours that are not straight-forwardly attributable to the 
summative behaviour of the individuals they contain |[Tl|2l[3l|4l|5l. For example, the structure 
of the network of interactions in an ecosystem |l6l |7]| affects many of the system’s dynamical 
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behaviours including succession dynamics and community assembly rules |l8l|9]|, the stability, 
resilience and adaptive capacity of a community ifTOlfTTlfT^fT^rilll . the presence of alternative 
stable states uni [MO, and the system’s susceptibility to regime shifts IIO . 

From some points of view these system-level behaviours exhibit the appearance of design 
and/or characteristics in common with organismic functions such as development and complex 
phenotypes |[l9llMl2lll22i|23l- However, an ecological community is not, in most cases, an 
evolutionary unit ||4l|23l|24||; it is an assemblage of species each individually adapted to their 
biotic and abiotic conditions. Thus the complexity that an ecosystem exhibits is not the product 
of Darwinian adaptation at the community level Il25ll . Furthermore, at present we lack general 
organisational principles that can help us understand and predict how system-level organisation 
and function results from the many individualistic adaptations on which they depend Ol [M 
|23l |2^ |27l |28l |29l |30]|, in particular, the reciprocity between the ecological dynamics on the 
network and the evolutionary changes to the nodes, and hence, connections of the network 
on l30l on l33l [34l l35l |36l [33. In short, we do not know how the coevolution of the parts 
affects the organisation and subsequent behaviour of the whole, i.e. the ecosystem’s dynamical 
properties such as the location and number of its dynamical attractors;the trajectories it takes 
towards its these attractors (assembly rules); its stability during assembly and/or succession; 
and its sensitivity to initial conditions during assembly. 

Characterising how evolution and coevolution of the parts affects community-level proper¬ 
ties is vital to understanding the responses of ecological communities to changes in environment 
at all scales. This issue is particularly acute in microbial community research, including med¬ 
ical applications in gut flora, where rapid evolution ll^ has the potential to alter the function 
of those communities we depend upon most intimately, and where there is significant interest 
in how parental effects create a footprint of community composition that may be remembered 
throughout life Il39l . Coevolutionary processes in gut microbiota have shaped at least three 
alternative stable states (termed enterotypes) ll40ll . but it remains unclear how the historical 
conditioning of different communities’ networks of interactions evolve in response to environ¬ 
mental changes in cases such as the use of antibiotics ll^ and societal changes in diet ||42|], or 
how these changes affect the emergent properties of community networks ll^ given the alter¬ 
nate enterotypes that act as attractors for these systems. At the macroscopic scale. Case et al. 
speculate that co-evolutionary processes maintain the distinct bird assemblages on the islands 
of Bali and Lombok, either side of Wallaces line ll^ |45l |4^. Although birds are relatively 
unimpeded by the short stretch of sea that has separated terrestrial species, each island main¬ 
tains distinct avian communities, and the conjecture is that long periods of coevolution within 
each community has created ‘coevolved’ biogeographic provinces, each network maintains a 
stable state resistant to invasion by members of the other Yet, without a framework link¬ 
ing microevolutionary changes in interactions between species pairs to dynamical behaviours 
of whole communities, it remains moot as to whether a network of coevolved interactions could 
be the explanation for the observed dynamical stability. 

The need to characterise the evolutionary and historical determinants of ecological processes 
is identified as an important frontier in ecological research [l29l . Understanding the evolution 
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and adaptability of ecological interactions is necessary, for example, to characterise the response 
of an ecosystem to climate change or other perturbations ifTSl [Til l47l l48]l and, more generally, 
to understand how the number and location of dynamical attractors (alternative stable states) 
are affected by the organisation of ecological interactions acquired over evolutionary time liTTlI . 

These issues connect deeply with the phenomenon of ecological memory ll29l l49l l50l ISTIl 
defined by Thompson et al ll29]l as “the result of past environmental conditions and subsequent 
selection on populations [which] is encoded in the current structure of biological communi¬ 
ties and reflected in the genetic structure of species”. As an illustrative example, consider the 
phenomenon of character displacement, ll52l [53]] in which niche divergence between pairs of 
isomorphic competitors leads to (genetic) trait divergence and increased likelihood of future 
coexistance; subsequent communities’ distributions are shaped by the “memory” of past com¬ 
petition. Within ecosystems these genetic memories, distributed amongst multiple populations, 
influence assembly processes, stability, and resilience of the developing and mature ecosystem 
ll29ll . However, there remain many open questions about exactly how the microevolutionary 
modification of interspecific relationships by natural selection shapes any macroevolutionary 
memory at the community level ll54ll^ . For example: 

1. How do changes to interactions evolved in past environmental conditions alter the re¬ 
sponse of the community to future changes or perturbations in environmental conditions? 

2. Is ecological memory merely a passive memory (like an imprint in clay) where the per¬ 
sistent effects of the most recent ecological states over-write or blend with those of older 
states, or can an ecological memory retain information about multiple distinct past states 
without just averaging them? 

3. Can the assembly rules and succession dynamics of a community be systematically or¬ 
ganised by selection in past environmental states? 

4. How does the formation of an ecological memory affect the possibility of alternative 
ecological stable states, and regime shifts under subsequent environmental forcing? 

The lack of a theoretical framework that links individual adaptations to collective behaviours 
leaves such questions unanswered. Our aim in this paper is thus to introduce such a framework. 
We do this by converting and exploiting theory that is already well-developed in another domain, 
namely, connectionist models of memory and learning. Below, we discuss the characteristics 
of connectionist models and their relationship to eco-evo dynamics. We then show a formal 
equivalence between these systems. We conclude that community-level organisation does not 
require community-level selection. The organisation of a community can be conditioned by past 
experience (collectively habituated to past environmental conditions) in the same sense, and 
with the same consequences for collective behaviours at the community level, as connectionist 
models of memory and learning. In order to demonstrate how making this general link between 
these disciplines leads to new insights about specific ecological behaviours, we then simulate 
mathematical models derived from this framework to address the above open questions about 
ecological memory. 
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Connectionist models of memory and learning 

Connectionism is an approach to modelling cognition, in particular using neural networks, that 
explains how complex system-level behaviours can arise via the appropriate organisation of 
many simple components. The first important contribution of these models is to show that 
although eaeh unit in a network might be very simple (e.g. the aetivation level of a neuron 
is simply a non-linear sum of the weighted connections from other neurons Il55l l56l l57ll l. if 
appropriately organised/connected,a network of such units can provide many remarkable col¬ 
lective behaviours, including: a) forming a distributed memory for one or more configurations; 
b) pattern reeognition from partial stimulus; e) the removal of noise from eorrupted composi¬ 
tions; and d) classification of ambiguous inputs |l55l |56l |57l 158]]. It has been noted in many 
different domains that the collective behaviours that can be exhibited by neural networks are 
not exclusive to neural models and can be exhibited by other types of dynamical systems (e.g. 
gene regulation networks, immune systems, multi-agent systems, economic systems and social 
networks) ll59l ]^ 1^ l62l l6^ l64l l65]l . This includes ecologieal networks (where the growth 
rate of a speeies is modelled as a non-linear sum of the weighted fitness-interactions with other 
speeies) |]66ll6^l65]l . 

A deficit in the analogy between neural networks and ecosystems is that whereas neural 
networks acquire the organisation necessary for their collective behaviours through learning 
mechanisms designed for that purpose, ecological connections are modified by individual-level 
natural selection with no such system-level purposes in mind. Although eeological networks 
may have population dynamieal similarities with neural aetivation dynamies in neural networks, 
there has not been any reason to expect that both systems may be organised in a similar man¬ 
ner. However, connectionist models also show that network organisations sufficient for many 
collective behaviours can be generated via learning mechanisms that modify the strength of 
connections according to only very simple and loeal reinforeement prineiples even by mech¬ 
anisms that do not require any system-level reward or performanee-based feedbaek. The full 
signifieanee of this for the evolution of eeological networks has not been previously appreeiated 

ia. 

Learning mechanisms in neural network models have two basic types ll67]l . Supervised 
learning utilises an external reward signal, or error function, to direct incremental ehanges to 
connections. We have recently demonstrated a formal equivalence between supervised learning 
and the evolution of eonneetions in a network that is seleeted (at the system level) to produee a 
particular target phenotype or phenotypes Il60ll67]l . However, in the absence of a group selection 
mechanism there is no target phenotype directing selection at lower levels within ecological 
communities; supervised learning does not oeeur at this scale. 

The other type of learning in these systems is unsupervised learning (Box 1), whieh oper¬ 
ates without a reward signal. This may seem eounter-intuitive but, when learning eorrelations 
or associations, learning what things often go together has many useful properties that can be 
attained without a supervisory signal to indicate what things should go together Il5^l57ll^l69]l . 
Thus, whereas supervised correlation learning reinforces correlations that are good according 
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to some external reward signal, unsupervised correlation learning changes connections simply 
to reinforce correlations that axe frequent. Hebbian learning ifTOll is the simplest unsupervised 
correlation learning mechanism and is well-understood in neural network models of memory 
and knowledge representation |l56l|57l|^. Under Hebbian learning, the change in strength of 
a synaptic connection, Acujj, is proportional to the co-activation of the neurons it connects: i.e. 
Acujj = rXiXj, where r > 0 is a learning rate, and Xk is the activation level of node k. This 
type of learning instantiates a very simple positive feedback principle between behaviour and 
connections, often paraphrased as “neurons that fire together wire together”. The effect of such 
changes is that correlation becomes causation, i.e. variables that happen to be both active at the 
same time (e.g., because they are stimulated by the same external conditions) become causally 
related by connections internal to the system, and thus their behaviour becomes more correlated 
in future. In this manner the network habituates to the perturbations it experiences by internal¬ 
ising information about the pattern of perturbation it has experienced into the organisation of its 
connections. 

This simple principle is capable of producing many remarkable collective behaviours eluci¬ 
dated over more than 50 years of neural network research Il5^l57ll69ll . Famously, this includes 
the ability to develop of a distributed associative memory which can store and recall multiple 
patterns of activation in the organisation of synaptic connections ll57ll . facilitating the use of 
these networks use in pattern recognition, noise reduction and classification (fig [T]). A main 
contribution of this paper is to show that in ecological communities, given heritable variation 
in ecological relationships and certain conditions on ecological constraints, these positive feed¬ 
back principles obtain from the action of individual natural selection IItTII . Table 1 sets out the 
full analogy we make between connectionist learning in neural networks and eco-evo dynamics 
in ecosystems, starting with the previously recognised dynamical equivalence (Table l.a-f). 

The biological evidence for positive feedback between ecological and evolutionary dynam¬ 
ics is entirely intuitive and already recognised in many areas where populations shape their fu¬ 
ture selective pressures (e.g. niche construction 11721 and refs, within]) but the full implications 
of this feedback have not been realised llT^ . For example, this feedback is part of the backstory 
involved in invasional meltdown 117^17511761 where species that have been in prolonged contact 
with one another in one environment facilitate one-another’s invasion into a new environment 
because they “have had a long evolutionary time to develop a cosy relationship with each other” 
ll74l . Notice the simple positive feedback involved; species that occur in high density at the 
same time and under the same environmental conditions coevolve to become less competitive 
with each other over time. In turn, this reduction in niche overlap makes it more likely that they 
will coexist in high-density together in future. Our first key result is to formalise this principle 
with population genetics and show its equivalence with unsupervised correlation learning (Ta¬ 
ble l.g). Then, to demonstrate how this opens-up a transfer of concepts and results between 
these domains, we use numerical simulation to show conditions where an ecosystem can ac¬ 
quire, hold and recall distributed information about past environmental conditions i.e. form a 
distributed ecological memory. This demonstrates several phenomena that are well-understood 
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Box 1: Hopfield networks and unsupervised learning using Hebb’s rule. 

The Hopfield network model Ell originated from the hypothesis that it is the structure of connectivity 
between units in the central nervous system, rather than differences between the units themselves, that 
is most important in understanding the brain’s complex behaviours. These simple models are fully 
connected networks of identical units. As units are identical it is solely differences in connections 
between units that determines the behaviour of each network. Despite this simplicity, these systems 
display complex behaviours, including the capacity to form multiple distributed memories; indeed, 
they are the simplest systems that have this capacity. Hopfield networks (and neural networks in 
general) are able to form multiple memories of configurations because, for each memory they store 
correlations between units, rather than the states (or outputs) of units. An effect of this architecture 
is that the structure of a Hopfield network can be updated to enable it to learn new patterns without 
over-writing and destroying pre-existing memories (figure [T]). 

Hebb’s rule is an unsupervised learning technique that can be used to train Hopfield networks to 
form memories for one or more configurations. For each training pattern Hebbian learning alters 
connections between units in the direction that reinforces the correlations between those unit’s 
current outputs. If two units have the same state in multiple patterns they will become strongly 
correlated; Hebb’s rule causes units that ‘fire together’ to become ‘wired together’. Hebb’s rule is 
an ‘unsupervised’ process because it does not utilise quality functions on the data used to train a 
network (whereas a supervised process might, for example, use a quality metric to scale changes 
made to the network). That is, Hebbian learning only acts to reinforce ‘frequent’ correlations in 
the training data, rather than correlations that are ‘optimal’ according to some metric of system 
performance (as in supervised learning methods). 



Figure 1 : Network training: Unsupervised learning processes as used to train a Hopfield network 
to store two configurations, patterns A and B. Each unit in the Hopfield network corresponds to a 
pixel in the image display. Six units are highlighted to illustrate the changes to connections during 
training in pattern A. Hebbs rule alters connections between units such that units of the same sign (1:1 
or -1:-1) become more correlated (blue lines) and units of opposite signs (1:-1 or-1:1) become more 
anti-correlated (red lines). Network behaviour: Training the network on both patterns results in a 
network with attractors (a.k.a. memories) for these patterns and system dynamics result in all initial 
conditions converging to one of the trained patterns (a). This behaviour enables these systems to be 
used for a variety of functions, including: b) recovery of complete composition from partial input; c) 
noise reduction; and d) classification (the input image is a closer match for the plane configuration 
than the bird configuration). 
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Table 1: Mechanistic equivalence between evo-eco dynamics and learning neural networks, and a map 
for the comparisons and analogies made in this paper, a-f) The basic components of the analogy made in 
the introduction to this paper, g) The main contribution of this paper (discussed in part I) the equivalence 
of individual natural selection acting on inter-species interactions with a simple associative learning rule 
such as Hebbian learning. Thus ecological networks evolve like neural networks learn (fig. 0. h-m) 
From this the phenomenology shown in our experiments follows (simulation results, fig. [^&|5 ). 



Unsupervised correlation learning 

Coevolution 


Activation dynamics 

Population dynamics 

a) 

Neural activation level 

Species density, Xi 

b) 

Neural activation pattern 

Ecological state, X = {xi,X2, ...xn} 

c) 

Synaptic connection strength, ujij 

Inter-species fitness interaction, uoij 

d) 

Neural network 
(weight matrix, W). 

Ecological network 
(community matrix, f^). 

e) 

Neural activation dynamics: a non-linear weighted sum of inputs 
from other neurons (and external inputs). 

Ecological population dynamics (Eq. 1): species growth is a 
non-linear function of the sum of weighted fitness interactions 
from other species (and environmental changes to carrying ca¬ 
pacities). 

f) 

External input patterns 
(aka. ‘training set’). 

Environmental forcing 

(in multiple environmental conditions) 


Correlation learning 
(unsupervised) 

Evolution of interactions 
(individual selection only) 

g) 

Positive feedback between activation strengths and connection 
strengths aka. neurons that fire together wire together. Unsu¬ 
pervised correlation learning mechanism, Hebb’s rule: Accjj = 
rxiXj, where r > 0 is a learning rate. 

Positive feedback between ecological densities and connections 
or species that occur together wire together. Direct effects of 
individual natural selection on interactions: Vij = rxjXj, where 
r = describes the available mutation (Eq. 3). 


Collective behaviours in neural networks 
(arising from e.g., Hebbian learning, Fig[^ 

Collective behaviours in ecosystems 

(arising from individual selection acting upon interspecific cor¬ 
relations) 

h) 

Memory formation (fig top panel) Hebb’s rule organises 

synaptic connections to reinforce the state of the system, de¬ 
creasing sensitivity to changes in input. 

Ecological memory formation (fig 3): natural selection organises 
ecological relationships in a manner that reinforces the current 
ecological state, decreasing sensitivity to changes in environ¬ 
mental conditions. (Attractors due to environmental variables 
become attractors of community dynamics flTl.) 

i) 

Distributed associative memory facilitates a memory of multi¬ 
ple patterns (fig[T]a): the capacity to store multiple patterns of 
activation in the organisation of synaptic connections and recall 
patterns from any initial conditions via activation dynamics. 

Eormation of alternative stable states (fig.|^a): the creation of a 
distributed ecological memory in the network of species interac¬ 
tions results in a system with attractors that mimic past ecologi¬ 
cal states. 

j) 

Pattern reconstruction (fig[^b): the recall of a complete pattern 

from a partial stimulus. 

Ecological assembly dynamics (fig. [^b): reconstruction of a 

particular community composition, from a subset of that com¬ 
munity. 

k) 

Error correction (fig^c): the ability to remove noise from a 

pattern, repair imperfections and restore a complete pattern. 

Ecological resilience (fig. [^c): the ability to recover from per¬ 

turbations in species densities and restore the complete commu¬ 
nity. 

1) 

Recognition or classification of an input or stimulus (fig[^d): 

return the nearest attractor from ambiguous initial conditions. 

Ecological sensitivity to initial conditions (fig. [^d): the switch¬ 

like change in response to small variation in initial species den¬ 
sities. 

m) 

Holding state in dynamics: Hopfield networks and other recur¬ 
rent networks have an internal state that allows them to display 
temporal dynamics (independent of input). 

Ecosystems hold state in population dynamics (fig. |^: in sys¬ 

tems with multiple attractors this results in a communities capa¬ 
ble of hysteresis with tipping points between states. 
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in connectionist models of memory and learning (Table l.h-m). 

The formal link between the disciplines does not depend on the specific scenarios relevant to 
investigating ecological memory nor on the simplifications that are necessary for the simulation 
models; for this reason we divide our work into two parts: I) an analytic model and results 
concerning the general equivalence, II) simulation methods and results concerning ecological 
memory. 


Methods Part I: A Model 


Ecological dynamics 


We model an ecosystem state as a vector of population densities over all N species, X = 
{xi, X 2 , Xiv}, (Xi > 0), and an interaction network, or “community matrix” Q, fl, where each 
element, coij, represents the fitness effect of species j on species i relative to i on itself {uu = -1). 
We assume \/i,j : ojij < 0, e.g. competitive (non-trophic) interactions such as via competition 
for resources. A Lotka-Volterra competition equation (Eq. 1) defines the rate of change of 
density of a species as a function of its intrinsic growth rate and a weighted sum of interactions 
with all other species ll66ll : 



( 1 ) 


where Xj is the density of species i, rrii is the intrinsic net growth rate of species i, kie is the 
carrying capacity of species i in environment e (i.e. its density before interspecific competition), 
and N is the number of species in the network. The dynamical equivalence between models 
of this sort, where populations experience exponential growth asymptotically approaching a 
threshold, and those models used in neural networks of excitation/inhibition between neurons 
is well recognised IIMl and refs, within]. We now turn our attention to the selective pressures 
on interspecific interactions, and make new comparisons with unsupervised learning in neural 
networks. 

Evolution of interactions under individual selection 

Each interaction coefficient summarises how a variety of structural, physiological and behavioural 
traits affect the degree to which one species impacts the population growth of another. Although 
subject to bio-physical constraints, e.g., stoichiometric constraints on resources, these interac¬ 
tions can often be modified by the evolved characteristics of the constituent species, e.g. traits 
that alter the overlap of habitat preference or resource utilisation profiles fTTlI or the time, effort 
or energy expended on a particular ecological resource or relationship. 

We assume that only individual-level selection acts on these interactions. We do not model 
selection on whole ecosystems (e.g., via a population of ecosystems), nor on species. Thus 
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only changes to traits that directly affect the growth rate of an individual compared to the rest 
of the individuals in the species can be selected. Individual selection acts to decrease the com¬ 
petitive effects from others by changing but note that an individual has no intrinsic interest 
in altering the growth rate of others by changing coji. Changes that decrease the density of a 
competitor, for example, cannot be selected for under individual selection as (in the absence of 
group selection) such changes benefit all individuals in a species irTSll . Therefore any changes 
to a species growth rate that occur as a side-effect of altering the density of some other species 
(e.g., via changes to uji or via ecological trade-offs below) are not affected by individual selec¬ 
tion (Appendix a). 


Analysis of individual-level natural selection acting on ecological interac¬ 
tions 


We analyse the rate of accumulation of favourable mutations, v, in each interaction coefficient, 
coij. In order to study the dynamical interaction between evolutionary and ecological dynamics, 
we are particularly interested in how the evolution of cOij is sensitive to the current species 
densities. The qualitative picture is as follows: Occasionally, mutants arise in species i that are 
identical to i except for the modification of an interaction coefficient with another species j' 
in the ecosystem. The origin and establishment of such a mutant can be modelled by applying 
population genetics theory 11791 ISOll to the particular case. From the ecological dynamics it 
follows that the selective coefficient, s, conferred by the change, g, in the interaction coefficient 
coiji, is the change in the invasion rate per capita of a mutant type of species i relative to the 
growth rate per capita of species i without the mutation: 


rui 


N 


S = 


kie ^ ^ iOijXj “ 1 “ gXj/ 

i=i 


rUi 


N 


kie ^ ^ 


rUi 


^ij^j I 


-gxf 


( 2 ) 


i=i 


(Simplified as s = henceforth.) Since m, k and x are positive, a favourable mutation 

requires only g > 0. Qualitatively, this means that a mutation to an individual of one species, 
e.g. a change in its habitat or resource usage, is selected for if the mutation reduces the negative 
influence of another species on its growth rate. We assume that in all species such mutations 
occur at rate g per individual per generation. In general, the rate of accumulation of such 
mutations is equal to the product of the number of individuals, Xi, the beneficial mutation rate, 
g, and the average probability that a single new mutation will ultimately fix, P, such that: 
V = XigP ||80l]. In large sexual populations with linked loci, P will depend on v, and in 
different ways depending on the type of recombination, recombination rate, population size, the 
mutation rate and magnitude of mutations |I791[HQ]|. For unlinked loci, in small populations, or 
under strong selection and weak mutation where mutations occur serially, P is proportional to 
the selection coefficient, s [fSOll . Since the effects we want to investigate do not depend on the 
effects of sexual recombination it is sufficient for our purposes to model the rate ofadaptation 
in this simple manner. In this case, the rate of adaptation, Vij, in an interaction coefficient, Uij, 
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is given by: 


(3) 


rrii 

Vij = Xifis = —gjjLXiXj 
^ie 

In more complex cases, where there is interference between alleles at different loci, Vij may not 
be linearly proportional to XiXj as it is in Eq.3, but in all cases, the rate of evolutionary change 
in an interaction coefficient increases with the product of Xi and Xj since mutations must be both 
created and selected in order for an interaction coefficient to evolve. This is robust to the choice 
of underlying model (Appendix b). This is entirely intuitive: a) if suitable heritable variation in 
relationships is available, natural selection always acts to reduce the negative effects of others, 
and b) the rate of adaptation of the interaction coefficient between two species, e.g. by character 
displacement, is driven by their co-occurrence Il54l . 

This is our first key result, describing how selection acts on inter-species relationships as a 
function of the current ecological state (Table l.g). Eq. 3 tells us that the rate of adaptation on 
inter-species relationships is proportional to the co-occurrence of the species involved: Hence, 
species that occur together (arise in high density at the same time and under the same condi¬ 
tions), wire together (and there will be selection for changes to interactions that makes those 
species more likely to co-occur in future) - as per the principle of unsupervised correlation 
learning. (Correlation learning can be produced either by a reduction in negative interactions, 
as here, or by an increase in positive interactions, with the same effect on system dynamics, i.e. 
either will increase the future co-occurrence of the species that have co-occurred in the past.) 
We now investigate the consequences of this finding for collective behaviours in an ecological 
community, using ecological memory as a case study. 


Methods Part II: Simulation 

In general, Eq. 1 may exhibit unstable or even chaotic behaviour. In the following investigations 
we restrict our simulations to interactions that are symmetric (Vz, j : iOij — iOji) as per compe¬ 
tition for shared resources or for competition coefficients estimated from utilisation functions 
imil, in which case the dynamics have only fixed point equilibria Ii82ll . During simulation 
we allow the ecological dynamics to equilibrate at each time step (over r iterations of Eq.l). 
Then all interaction coefficients are updated according to the direct effect of natural selection 
in proportion to the rate of adaptation (Eq. 3). Then ecological constraints are applied to these 
interactions as follows, and the process is repeated. 

Ecological constraints/evolutionary trade-offs on changes to ecological in¬ 
teractions 

In ecosystems where niche space is saturated, the capacity of natural selection to alter inter¬ 
actions is subject to inevitable ecological constraints and evolutionary trade-offs that prevent 
selection from eliminating all competition. Individuals with traits that cause them to avoid 
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competition with one species may be forced to compete more with others. Thus the interac¬ 
tion between two species is more generally governed by a) the evolvable characteristies of the 
speeies as described by Eq.3, and b) evolutionary trade-offs or eeological constraints applied by 
the physieal properties of the environment (e.g., energy spent on exploiting one resouree cannot 
also be spent exploiting another). Here these trade-offs are represented by normalisation condi¬ 
tions that conserve the sum of interactions to and, by symmetry, from each species. Specifically, 
for all species i and j (j ^ i), Y.f=i = Qi and = Qj, where Qi = Qj < 0 

is a eonstant (the sum of interaetion terms in row/eolumn i at time f = 0) (see Appendix e). 
Sueh normalisation represents eeological niches that resist change in width more than ehange 
in location, e.g. individuals can more easily change which resources they depend on than how 
dependent they are overall ll8^ . 

Although natural seleetion always aets to reduee eompetitive impaets from others, the faet 
that the rate of adaptation is greater for some eompetitive interaetions than others (Eq. 3), to¬ 
gether with these normalising evolutionary trade-offs, will mean that the eompetition between 
some species will increase. When the interaction, coij, from some species j to a given species 
i is, for example, made less competitive (decreased in magnitude) by the evolution of herita¬ 
ble traits, all the other interactions involving i, i.e., ojih (h ^ j) and Uhi (h ^ i), are made 
more competitive by these normalising evolutionary trade-offs. This, in turn, leaves all inter¬ 
actions not involving i relatively less eompetitive. Self-interactions are not modified by either 
evolutionary or normalisation mechanisms {ujU = —1). 


Environmental forcing 

To investigate ecological memory we are interested in how the evolution of ecological inter¬ 
actions is influenced by past ecologieal states. To model the evolution of an ecosystem under 
varying environmental conditions that force or drive the ecosystem to adopt different eeolog- 
ieal states, we define two environmental eonditions, Ei and E 2 , that have differing effects on 
the carrying capacities of the species (Appendix c). Relative to a default environment Eq, en¬ 
vironment El increases the carrying capacity of some species and decreases others, whilst in 
E 2 , a different subset of species is increased/decreased. Ei and E 2 may represent hot-dry and 
cold-wet elimates, for example; or high/low levels of some key broadly-utilised resource sueh 
as phosphorous input rates for a lake habitat ||48]|. Given that individuals from each species 
experience both conditions over evolutionary timescales, these conditions could vary in space 
(e.g. geographic localities, rather than in time (e.g. seasonal change). To make the effects 
of these two conditions on community composition easily identifiable we utilise environmental 
forcing patterns corresponding to two arbitrary but easily identifiable pietograms (Fig. |^. Here 
the hot and cold pietograms describe two different eonfigurations of species densities represent¬ 
ing, for example, hot dry savannah and cold wet/temperate ecological states, respectively. The 
environment is switched between Ei and E 2 every T evolutionary updates. 
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Carrying capacity 
■ Elevated 
□ Depressed 


Figure 2: The carrying capacities of 400 species are affected differently by two different environ¬ 
mental conditions, Ei and E 2 . For our purposes, the specific patterns of carrying capacities for the two 
conditions are arbitrary and can thus be depicted by 20 x 20 pixel ‘hot’ and ‘cold’ pictograms where 
a black pixel at location x, y indicates an elevated carrying capacity, (fco + a), and a white pixel a de¬ 
pressed carrying capacity, (/cq — a), for the (20x + y + 1)^^ species in the ecosystem. Appendix c (the 
two-dimensions of the pictogram are abstract and do not imply any spatial arrangement of the species). 


Model parameters of the simulations and methods used for assessing ecological attractors 
are described in Appendix c. 


Results 

We use the series of four open questions concerning ecological memory listed above to exem¬ 
plify some of the implications of our general result. 

i) Changes to interactions evolved in past ecological states canalise the re¬ 
sponse of the community to subsequent changes in environmental condi¬ 
tions or future perturbations. 

Experiment 1 investigates how evolution in fixed environmental conditions changes the eco¬ 
logical dynamics of the community. Before the evolution of interactions, during the ecological 
phase of simulation, the ecosystem arrives at a stable equilibrium corresponding to the pattern 
prescribed by the current environmental forcing (Figs, [^a and[^b). Inter-species interactions 
are then evolved in environment Ei, i.e., without changes to the environmental forcing during 
evolution. The process is repeated for 800 ecological and evolutionary cycles. We then assess 
how evolved interactions have altered the sensitivity of the ecosystem to subsequent environ¬ 
mental forcing. We find that the ecosystem now arrives at a stable equilibrium corresponding 
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(b) Equilibrium states from different initial conditions 
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(c) Equilibrium states from different initial conditions after evolution in El 


Figure 3: Ecological dynamics before and after evolution in Ei. a-b) Before evolution of interactions, 
when forcing is applied, some species densities increase, others decrease, a) Four species responding 
differently to Ei and E 2 (H=‘high’, L=‘low’). b) Vectors of all species population densities are displayed 
in a pixel array as per Fig. Under a given pattern of environmental forcing (top row), an initially 
random pattern of species densities (middle row), equilibrates at a pattern of species densities (after 
T timesteps) (bottom row). Initial species densities do not alter the attractor attained (5 independent 
examples), c) After evolution of interactions in Ei, equilibrium states are governed by that past pattern of 
environmental forcing and not by the current environment. This ecological memory is a stable attractor, 
reached from any initial pattern of species densities, regardless of the pattern of environmental forcing 
(some distortion is visible under E 2 forcing). 
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to the El pattern (the pattern it experienced when interactions were evolving) even when the 
environmental forcing is subsequently changed to Eq or E 2 (Fig. |^c). Experiment 1 thus shows 
that the effect of evolving ecological interactions by individual natural selection under fixed en¬ 
vironmental conditions is to create a stable attractor for the specific ecological state experienced 
in that past environment, reducing the responsiveness of the ecosystem to respond to subsequent 
environmental forcing, and increasing the adaptive capacity of the system to withstand changes 
to environmental conditions or perturbations to population densities. This behaviour demon¬ 
strates the basics of an ecological memory, but only a memory of one pattern. Even passive 
systems can remember one pattern, e.g. an imprint in clay, but connectionist models show that 
a dynamical network is capable of storing and recalling multiple patterns. 


ii) Ecological memory can retain and recall information about multiple dis¬ 
tinct past states. 

In Experiment 2 varying environmental conditions are applied to cause the ecosystem to adopt 
two different ecological states (Ei and E 2 ) repeatedly whilst inter-species interactions are evolv¬ 
ing. The effect of these evolved changes plus normalising evolutionary trade-offs are illustrated 
in Fig|^ We see that their evolution is identical to Hebbian learning (again this is robust to the 
choice of underlying model. Appendix d). 
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Selection 
in E2 


(c) 

Selection 
in El and E2 
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Resultant changes 
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(e) 

Hebbian changes 
to interactions 
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Figure 4: Evolved interactions are identical to Hebbian interactions. Change in interactions between 
the first 16 species are shown, a-b) Some of the competitive interaction coefficients are decreased by 
the direct effects of selection in Ei and E 2 , respectively, c) The combined effect of selection in the two 
environments is that some interactions are decreased in both environments, some in only one environment 
and others in neither environment. This depicts the relative rate of change due to direct selection effects, 
d) When normalising ecological constraints are taken into account, some interactions are decreased, 
some left unchanged, and others are increased. The resulting changes are identical to (e). e) The result of 
Hebb’s rule applied to the interactions between the first 16 species summed over Ei and £’2 (r is scaled 
to give the same mean magnitude as (d)). 

After evolution we find that, in the absence of further environmental forcing, the ecologi- 
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cal dynamics have two stable attractors corresponding to Ei and E 2 , reached from any initial 
species densities (Fig. |^a.. Appendix c). An ecological memory can thus retain information 
about multiple distinct past states without just averaging them or blending them (for example, 
the system does not have an attractor for the union of both patterns). 

iii) The assembly rules of a community can self-organise to recreate past 
environmental states. 

After evolution in the varying environment (Experiment 2) either of the two patterns can be 
completely recalled or assembled from an initial subset of species. That is, when the initial 
species densities have just a few species present in a density that matches one of the previous 
patterns, the ecological dynamics act to recreate the full pattern to which that ‘partial stimulus’ 
belonged (Fig. |^b). This experiment also reveals more about how the stability and resilience 
of the community is affected by the presence of multiple memories. When the initial conditions 
are ‘corrupted’ versions of a previous pattern, the complete pattern is restored, even when the 
corruption is severe (Fig. |^c.) (thus maintaining/re-creating the current ecological pattern), 
and when the initial species densities partially resemble both patterns, the population dynamics 
‘break symmetry’, causing all species to adopt the pattern to which the initial conditions are 
closest (thus ‘choosing’ between two ecological states - not blending them). 


iv) Ecological memory can create multiple ecological stable states, and may 
exhibit critical transitions between them under subsequent environmental 
forcing. 

Fig. 1^ examines the response of the ecosystem to patterns of environmental forcing that change 
linearly from Ei to £’ 2 - Before the evolution of interactions, the response of the ecosystem is 
proportional to the environmental forcing applied (Fig. |^a). In contrast, after the evolution 
of interactions (Experiment 2), the response of the system is discrete or switch-like and ex¬ 
hibits significant hysteresis (Fig. |^b). That is, as the pattern of environmental forcing moves 
incrementally from £1 to £ 1 , the response of the system is to stay on £1 considerably past 
the mid-point and then suddenly switch to £ 1 . Conversely, when the environmental forcing is 
reversed, the ecosystem retains a configuration matching £1 considerably past the mid-point 
before switching back to £ 1 . The dynamics underlying this hysteresis loop are shown by the 
vector field of species densities changes (Fig. |^c. Fig. |^a). This also shows that the response of 
the population dynamics to perturbations in species densities slows down near the critical tran¬ 
sition (consistent with early-warning signals for a tipping point ll84l[85]l ). Fig. |^d. shows how 
the response of the ecosystem to forcing changes over evolutionary time. Around generation 
470, the ecosystem exhibits non-linear but non-catastrophic transitions ifT^ . The catastrophic 
regime change is not a general instability property of the evolved system it only occurs when 
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(b) initial conditions partially resembling El or E2 
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(c) Initial conditions that are corruptions of El or E2 





(d) initial conditions between El and E2 


Figure 5: Ecological dynamics after evolution in varying environmental conditions. The evolved 
ecosystem exhibits two attractor states (rightmost frames) that are reached from various initial species 
densities (leftmost frames), a) Random initial species densities develop into one of two possible attractors 
corresponding to the patterns of forcing experienced in the evolutionary past, b) Initial configurations 
that resemble a small part of Ei (i and ii) or E 2 (iii and iv) develop into equilibria that fully recreate 
El and E 2 respectively, c) Initial configurations that are partially randomised versions of Ei (i. 20%, 
ii. 80%) or E 2 (hi. 80%, iv. 20%) develop into equilibria that ‘repair’ the corresponding state, e) For 
initial conditions between Ei and E 2 , (Ei : E 2 ratio = i.80:20, ii.55:45, iii.45:55 iv.20:80) the dynamics 
‘recognise’ the pattern that is resembled most closely. 
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(a) Response to environmental forcing before evolution (no hysteresis) 
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(b) Response to environmental forcing after evolution (hysteresis) 



(c) Population dynamics 
after evolution 


(d) Population dynamics 
changing during evolution 


Figure 6: Response to environmental forcing before and after evolution in varying environmental 
conditions, a-b) Population dynamics under slowly-changing environmental forcing, changing first from 
El to E 2 (middle row, left-to-right), and then back again from E 2 to Ei (bottom row, right-to-left), 
a) Before evolution of interactions, changes in species densities are proportional to forcing, b) After 
evolution (Experiment 2), species densities show an abrupt switch between attractors with hysteresis, c) 
Vector field for the population dynamics. The unstable equilibrium is revealed at the boundary of the 
shaded region indicating where species densities move away from Ei . Points near the critical transition 
(solid circle) have slower population dynamics than points far from critical transition (dashed circle), d) 
Evolution of two-attractor system. Initially, change in species densities is proportional to environmental 
forcing. Around generation 470 non-linear but non-catastrophic transitions are observable. Finally, two 
stable attractors with a catastrophic transition and hysteresis. 
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the environmental forcing is similar to a past state that is remembered by the ecosystem un¬ 
structured forcing results in a linear response (Appendix e). 

These observations demonstrate a conversion of one type of ecological alternate stable state 
into another. Beisner et al. ifTTl describe the “ecosystem” perspective on alternate stable states, 
which involves changes driven by abiotic environmental conditions, and the “community” per¬ 
spective, which involves multiple attractor states that can exist under fixed environmental condi¬ 
tions. Fig. 1^ shows a system that converts alternate “ecosystem states” into alternate “commu¬ 
nity states”; thus converting patterns from past environmental states into ecological memories. 

Fig. [T^shows a ‘bestiary’ of ecological attractors changing over evolutionary time, showing 
some diversity before settling down to the two-attractors shown in Figs. |^and|^ During long¬ 
term simulation we find that, as the forcing used to switch the system between attractors is of 
fixed value, while the effect of the evolved changes to interactions is ever-increasing, eventually 
the level of forcing applied is insufficient to shift the system from its current attractor. When 
this happens, the system becomes ‘stuck’ at one attractor, effecting a breakdown in observed 
behaviour (Appendix f. Figs. [T0|&[TT]). 


Discussion 

Our results formalise the intuitive idea that individual selection on ecological interactions pro¬ 
duces positive feedback on species co-occurrence. By recognising an equivalence between this 
feedback and principles of unsupervised correlation learning we are able to use concepts from 
connectionist models to understand and illustrate the consequences of these changes for system- 
level behaviours. This makes several contributions to our understanding of evo-eco interactions: 

Evo-eco dynamics have predictable consequences for collective behaviours. The worked 
example developed in our simulations converts informal notions about the evolutionary and 
historical determinants of ecological processes into a model that makes specific predictions 
about how past ecological conditions alter the selective pressures on the component species 
and hence modifies their future ecological behaviours. This presents a specific model for non¬ 
trivial ecological memory that can be empirically tested (Appendix g). From this model we 
better-understand the necessary conditions for a distributed ecological memory to form, such as 
the presence of evolutionary trade-offs that cause species to become more dependent on other 
species lf86ll rather than just becoming less competitive with them (Appendix h). 

Ecological communities can exhibit organised collective behaviours. Under certain condi¬ 
tions, memories of past ecological states can be stored in a distributed way in the organisation 
of evolved ecological relationships. Such memories are not simply the summative or average 
result of multiple species each with individually alternate stable states. The connections that 
produce these behaviours are organised not by evolutionary adaptation at the community level. 
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but rather by evolutionary adaptation at the individual level and ‘past experience’ of historic 
environmental conditions. The organisation of the system is thus conditioned by past envi¬ 
ronmental conditions, causing it to collectively habituate to the patterns of perturbation it has 
experienced Il47ll . 

Community assembly rules can be organised to re-assemble specific past states. The assem¬ 
bly of complete and specific past ecological states may be triggered by partial environmental 
cues or a small number of founders (as in invasional meltdown) (Fig. |^b) or, similarly, the 
system can recover each specific state from corruptions of that state (Fig. |^c). The learned 
assembly rules result in a system that ‘classifies’ initial compositions according to their sim¬ 
ilarity to past ecological states and will return community composition to the state that most 
closely resembles initial conditions (Fig. |^d). Ecological memories can thus direct subsequent 
community assembly to recreate multiple past ecological states in a complex and collective, but 
predictable, manner. 

Stability and resilience tends to increase but instability and regime shifts are also predictable. 
We find that evolutionary pressures on ecological interactions tend to increase ecosystem re¬ 
silience (recovery after perturbations to species densities) (Fig. and adaptive capacity (robust¬ 
ness to environmental forcing) (Figs. [^and|^ lfT^[Tn[T^[T^lT7]l . However, if the evolutionary 
history of an ecosystem has included a multi-modal distribution of environmental conditions, 
then this can result in alternative stable states (rather than universal stability) and may exhibit 
critical transitions in changing from one state to another ifTOll . This switch-like change in the 
community (Fig. is only exhibited when the forcing that is applied is similar to past forcing 
when arbitrary forcing is applied the response may remain linear (Appendix e. Fig. |^. Critical 
transitions between alternate stable states may thus reflect memories of specific past states and 
are not necessarily arbitrary non-linear responses to the current forcing pattern. Past experi¬ 
ence of distinct environmental conditions (e.g. temperatures) may thus make future responses 
to related forcing (e.g. climate change) more likely to exhibit discrete changes in ecological 
states, critical transitions or tipping points ifTSl [TSll . This suggests that critical transitions are 
not necessarily the arbitrary failure of an ecological community but can be a matter of ‘recall¬ 
ing’ alternate states familiar from past conditions. 

Future work should explore the ultimate equilibrium of these evo-eco feedbacks (Appendix 
f. Figs. p^&[TT]), and investigate relaxation of some of the simplifying assumptions utilised in 
the memory behaviours illustrated here (Appendix h). In particular, this paper has not investi¬ 
gated the effect of evo-eco feedbacks on trophic (e.g. predator-prey) interactions or mutualisms, 
nor have we investigated the ecological analogues of other behaviours that can be produced by 
unsupervised learning in more general neural networks (e.g. with multi-layered or asymmetric 
connection structures). Some intriguing further research directions are also suggested: 

Do brains learn in the same way that ecosystems evolve? We have shown that ecosystems 
evolve in the same way that brains learn, but recognising evo-eco dynamics and connectionist 
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learning models as different instantiations of the same underlying adaptive mechanisms also 
sheds light in the other direction, i.e. on cognitive processes ifSTlISSl . 

Can an ecosystem gain from experience? The idea of sequential selection, where non- 
arbitrary organisation arises in a system over evolutionary time without selection being applied 
at the system level 11211 [89]l suggests that a biological community “may gain from experience” 
by using “a system ‘memory’ carried in the gene pool” ifTOll . Our work in other domains has 
shown that the more specific sense of system memory demonstrated in the current paper can im¬ 
prove the ability of an adaptive network If^ to solve constraint problems or optimise resource 
allocation problems (without an external reward signal) Il58ll . This suggests that adaptation at 
the ecosystem level is possible in a formal sense without group selection; not adaptation in a 
Darwinian sense, but rather in the same sense and by the same mechanism as connectionist 
models of organismic adaptation ll^ . 

Similarly, demonstration that ecosystems exhibit collective adaptive behaviours without be¬ 
ing units of selection prompts inquiry as to whether these systems are capable of more complex 
computational tasks. For example, natural ecosystems are under very many constraints that limit 
species abundance (e.g. NCP availability). Does selection on individuals improve a system’s 
ability to resolve these constraints? Hopfield networks are known to be able to solve complex 
constraint satisfaction problems Il90ll . Do these abilities translate to ecological networks? 


Conclusions 

We have introduced the framework of connectionist learning as a tool to expand our understand¬ 
ing of evo-eco dynamics and collective ecological behaviours. Within this framework we find 
that, despite not being an evolutionary unit, an ecological community can behave like an (un¬ 
supervised) learning system, creating internal organisations that collectively habituate to past 
environmental conditions, and actively recalling past responses to those conditions. 

Previously there have only been two choices in how to interpret collective behaviours in 
ecosystems i.e. either they have no system-level organisation or some mechanism of group 
selection must be involved. Our findings demonstrate that there is a third possibility. Ecological 
organisations that produce collective behaviours can arise from the positive feedback of indi¬ 
vidual natural selection and ecological population dynamics without invoking group selection. 
Specifically, given the presence of evolutionary trade-offs, the effect of individual-level natu¬ 
ral selection acting on interspecific relationships is dynamically equivalent to a mechanism of 
unsupervised correlation learning and ecosystems can thereby exhibit organised collective be¬ 
haviours via the same principles of connectionist learning that apply to neural networks. What 
is it that ecosystems learn? We find that they have the potential to learn where to go (i.e. evolved 
ecological attractors recreate past ecological states, where an attractor may be the climax com¬ 
munity resulting from a successional process ll^ ). how to get there (i.e. the successional or 
assembly process) and how to stay there (i.e. the relationships that increase the resilience and 
stability of those mature ecological states). Of course, interpreting evo-eco dynamics as a con- 


21 


nectionist learning system is not obligatory. A description in terms of individual natural selec¬ 
tion and ecological population dynamics only is entirely compatible indeed, we have provided 
this level of description for all the results in this paper. But recognising the equivalence with 
connectionist models enables us to convert and exploit well-understood concepts and results 
from this discipline to understand the organisation of ecological communities in new ways, and 
thereby to recognise the potential for predictable collective behaviours. 


Appendices 

Appendix a: Individual selection in ecosystems 

A mutation to an individual in species i that decreases the competitive effect, uoij, of species 
j on species i directly affects the fitness of the individual carrying the mutation and not other 
individuals in species i, and can thus be favoured by individual selection. It is only changes to 
traits that directly affect the growth rate of an individual compared to the rest of the individuals 
in the species can be affected by individual-level selection. Traits that increase the growth rate of 
all individuals in the species equally have no differential individual benefit (despite conferring 
benefit to the species as a whole). In particular, a mutation to a trait in an individual in species 
i that changes its competitive effect, Uji, on some other species j, e.g. decreasing the density 
of a competitor species, may thereby indirectly increase the growth rate of species i. But this 
will benefit all individuals in species i, not just the mutant, and therefore has no differential 
selective benefit to the individual that bears the mutation iTTSll . Likewise, the competitive effect 
of species j on species i may, by virtue of normalising ecological constraints, be decreased 
as a side-effect of increasing the competitive effect of species k on species i. But again this 
would not be favoured by individual selection as the benefit is felt by all individuals in species 
i (conversely, changes to coij could be selected under individual selection even though, as a 
result of indirect effects through changes in density of other species or through normalising 
ecological constraints, their net effect is to decrease the density of their own species). It is 
therefore only direct effects on individual fitness that are taken into account by the selection 
coefficient described here; i.e., Eq. 2. evaluates the change in growth rate of individuals in 
species i due to changes in coij and not ujji, and furthermore, only changes to uiij caused by 
positive selection coefficients, not those caused by indirect normalisation effects. This correctly 
disregards any changes to a species growth rate that occurs as an indirect side-effect of altering 
the density of some other species. 

Appendix b: The relationship between rate of adaptation and product of 
species densities in more complex cases. 

In the main text, the rate of adaptation, Vij, of each interspecific interaction coefficient is mod¬ 
elled with Eq.3 corresponding to the case where there is no interference between simultane- 
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ously segregating alleles at different loci. In large sexual populations with linked loci, the rate 
of adaptation will depend on the type of recombination, recombination rate, population size, 
the mutation rate and magnitude of mutations. Here we compare the rate of adaptation of an 
interaction coefficient for three different models. In each case, the rate of adaptation, Vij, of 
an interspecific interaction coefficient describing the fitness effect of species j on species i, is 
Vij = XifxP, where Xifx is the rate with which beneficial mutations arise in species i, and P 
is the average probability that a single new mutation will ultimately fix (see main text). In all 
cases, P is a function of the selection coefficient s* = ^gxj (Eq.2, main text) where m, is the 
intrinsic net growth rate of species i, kiS is the carrying capacity of species i in environment e, 
and g is the change in the interaction coefficient due to an individual mutation. Here we write 
Si = l3xj, for clarity of the comparisons that follow. 

Case a) No interference 

In simple cases when there is no interference between simultaneously segregating alleles at 
different loci (e.g. where genes are under weak selection per locus, free recombination and 
the linkage disequilibria among alleles sweeping to fixation are negligible), the probability of 
fixation, P = s*. Thus, as per Eq.3 main text: 

Vij = ^gXiXj (4) 

where Xi is the density of species i, Xj is the density of species j and g is the beneficial mutation 
rate. 


Case b) Linked genes on a linear genome 

Weissman & Barton liSOll consider the effects of interference between linked genes on a linear 
genome. Here the genomic rate of fixation of beneficial mutations is ( IISOll Equation 7): 

where, vq is the genomic rate of fixation of beneficial mutations in the absence of interference 
and R is the total genetic map length in Morgans. The authors use the approximation = 2x/us, 
where x is species density and s is the selection coefficient. With s* = Pxj as before, this gives 
the rate of adaptation on an interaction: 

. _ 2PgxiXj 

1 + 4:/3gXiXj / R 


Case c) Occasional outcrossing 

Neher et al. [l79l study the rate of adaptation in unlinked loci in facultative sexuals where 
the rate of outcrossing is very small. Whereas Weissman and Barton examine the case of ob- 
ligately sexual populations, this case represents occasionally/facultatively sexual populations 
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(e.g. plants). On condition that r^/s^ ^ Axfi, the rate of accumulation of beneficial mutations 
in this case is given by 1 117911 Equation 12b): 


V ~ XjlS^ ( 1 — 


Axjis^ 




(7) 


where r is the outcrossing rate. With s, = I3xj as before, this gives the rate of adaptation on an 
interaction: 

^2 l\ _ 4:Xill{l3Xjy 


Vij ^ Xin{l3xj 


( 8 ) 


Comparison of the three cases 
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Figure 7: Rate of adaptation Vij as a function of Xi and Xj for three different models, a) Eq.3 from 
main text, b) Eq.7 from Weissman & Barton lISOl , c) Eq.l2b from Neher et al. llT^ . We observe that (b) 
is very close to a linear scaling of (a) and, although (c) shows slight qualitative differences in the shape 
of the function, it maintains the essential qualitative characteristic. In all cases, the rate of evolutionary 
change in an interaction coefficient increases with the product of Xi and xj. (As per our simulation 
experiments: fcjg = 10, mj = 0.5, g = 0.1, /x = 1.0 x 10“®. Eor case b), the map length, R = 1. Eor 
case c), the out-crossing rate, r — 0.01.) 

Fig. I^plots the rate of adaptation Vij as a function of Xi and xj for these three different cases. 
We observe that case a, where the rate of adaptation is directly proportional to the product XiXj 
as modelled in our simulations, and the two more complex cases (b and c) are all qualitatively 
similar. Although in some eases the absolute rate of adaptation is more strongly limited by 
the reeombination rate than the mutation supply or the strength of selection, for example lISOll . 
the relative rates of adaptation are still determined largely by the produet of Xi and xj. More 
specifically, all three cases have the essential characteristic that the rate of adaptation is zero 
when either Xi or Xj is zero, and otherwise, the greater the value of one, the greater the rate of 


24 





increase with the other. Thus, although the shape of the alternate functions differs from ours, 
the essential behaviour is preserved. Intuitively, mutations must be both created and selected 
for an interaction coefficient to evolve. 


Appendix c: Additional methods: Normalisation, variable environments, 
measuring ecological attractors and model parameters 

Normalisation methods 

In each evolutionary step, all interaction terms in Q{t) are updated by natural selection ac¬ 
cording to Eq. 3 to produce and then renormalised to produce il{t + 1). Renormalisation 
preserves the conditions that for each species i and all other species j{j ^ i), Yl!j=i (^) = Qi^ 

and = Qi^ where Qi < 0 is a constant for each species. Specifically, an iterative 

row and column normalisation (below) is applied to M{k = 0) = Vl', until the values of M 
converge within a specified accuracy, i.e. -f 1) — nnijikyf' < 10“®, where k is the 

iteration counter, as follows: 


M{k + 1) = column_norm(row_norm(M(A:))) 


(9) 


where row_norm(mjj) = niu, column_norm(mjj) = mu, i.e. self-interactions are unaffected, and 


and 


row_norm(mjj(j^j) 


mij{k) 


( 10 ) 


column_norm(mjj (j^ ^) 


rriijik) 


( 11 ) 


Variable environments 

We investigate the effect of variable environments as follows. The carrying capacity of the 
species in a default ecological environment, Eq, is kio. For simplicity in our simulations we let 
kio — ko, for all i, where ko is a constant. Prior to the evolution of interactions, this causes 
all species to equilibrate at the same density. To model the evolution of an ecosystem under 
varying environmental conditions that force or drive the ecosystem to adopt different ecological 
states, we define two other environmental conditions that alter carrying capacities. The pattern 
of equilibrium species densities under one environmental condition, Ei, increases the carrying 
capacity of some species to ko + a and decreases others to ko — a, where a = 0.1. In £" 2 , a 
different subset of species is increased/decreased in a similar manner. See Fig. |^main text. 
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Measuring ecological attractors 

We examine the ecological attractors in the ecosystem by Monte Carlo sampling, i.e., by repeat¬ 
edly setting the species densities to random initial conditions and running to an equilibrium. To 
measure the inherent attractors induced by evolutionary changes, this sampling is carried out 
in the absence of environmental forcing i.e., in £"0. In some experiments we also investigate 
the amount of environmental forcing required to push the ecosystem out of equilibrium in one 
pattern of species densities and into the attractor basin of another stable equilibrium. Whenever, 
as here, interactions control the correlation of species densities and not their absolute densities, 
the complement of any attractor pattern is also necessarily an attractor Il57ll58ll67]l . However, so 
long as initial conditions are more similar to the past states experienced during evolution than 
the opposite of those past states these unnatural attractors are precluded. Accordingly, we exam¬ 
ine initial conditions, x, satisfying the condition (|x — £11 < \x — E[\) and (|x — £21 < |x — 
where £' is the inverse of £ (i.e. £' = 2£ — £). 

Model parameters 

N = 400, number of species. 

TTij = 0.5, growth rate of all species. 
s{t = 0) = 0.1, initial species densities. 

ko = 10, a parameter governing the extrinsic component of carrying capacity in Eq. 
q; = 0.1 increment/decrement of particular carrying capacities in environments £1 and £2. 

T = 1, number of evolutionary changes applied in each environment before switching, 
r = 5000, number of ecological timesteps (Eq. 1) between ‘initial’ and ‘final’. 
g = 0.01, constant of proportionality in selection-limited evolution (Eq. 3) 

Interaction coefficients are initialised as follows: 

, , I —1, if i = j (he. self interactions) 

cUiAt = 0 ) = < 

1^—0.2, otherwise 

Qi = = 0), normalisation constant (the sum of the non-self interactions in any 

one row/column remains equal to their sum at time t = 0). 

The quantitative values of these parameters will naturally have quantitative effects on the 
behaviour of the eco-evolutionary dynamics that we simulate. Since the simulations are a phe¬ 
nomenological model of ecosystem evolution, what matters is the relative rather than absolute 
rates of adaptation on different interaction coefficients in particular, which interactions in¬ 
crease, which decrease and which remain largely unchanged. This pattern, and its sensitivity to 
different modelling choices, is investigated in Appendix d. 
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Figure 8: Evolved changes to interactions are Hebbian in more complex population conditions. 

Change in interactions between the first 16 species are shown under evolution in a changing environment. 
Rate of adaptation is controlled by our equation (top row), that from Weissman & Barton ll80l (middle 
row) and Neher et al. 121 (bottom row), a-b) the change in interactions due to direct selection effects (see 
Fig. I^main text), d) When normalising ecological constraints are taken into account, some interactions 
are decreased, some left unchanged, and others are increased. The resulting direction of change is the 
same in all three cases and identical to Hebbian changes (Fig. |^e. main text), (kie — 10, rrii = 0.5, 
g = 0.1, /i = 1.0 X 10“^, a = 3.5. For case ii, the map length, R = 1. For case hi, the out-crossing 
rate, r = 0.01). For visualisation, the magnitude of changes in (d) are multiplied by 5. 


Appendix d: Equivalence of Hebbian and evolved changes in more complex 
cases 

In the main text the rate of adaptation of each interspecific interaction coefficient is modelled 
with Eq.3 corresponding to the case where there is no interference between simultaneously 
segregating alleles at different loci. Appendix b shows that the characteristics of the rate of 
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adaptation in more complex cases is qualitatively similar although they are quantitatively dif¬ 
ferent. Here we simulate evolution using these alternative models and incorporating normalising 
ecological constraints. Fig. shows that the quantitative differences in the three equations do 
not alter the pattern of positive, negative and neutral changes that are produced in the evolving 
interaction matrix. Specifically, the pattern of changes in interactions have the same direction 
as the Hebbian model in all cases. Accordingly, there will be parameter ranges where they pro¬ 
duce the same distributed memory phenomena in the ecosystem. Investigations of quantitative 
differences remain for future work. 

Appendix e: Response to environmental forcing that is not similar to envi¬ 
ronments experienced during evolution. 

Fig. 1^ shows that an ecosystem can exhibit a non-catastrophic response when forced in arbi¬ 
trary directions (b) and simultaneously exhibit hysteresis and catastrophic regime shifts when 
forced in directions that have been experienced previously over evolutionary time (a). This em¬ 
phasises that the evolved ecological memory causing the switching behaviour is conditioned by 
the systems’ evolutionary history, and thus causes recall (or recognition) of a specific point in a 
multi-dimensional space of species densities, rather than a general stability/instability property 
resulting from unorganised or arbitrary evolutionary changes. 



environmental forcing |^H 
™ (distance to El) ™ 


(a) 



A 

G[400] forced 

• 

G[400] released 

A 

G[550] forced 

• 

G[550] released 


Figure 9: Response to environmental forcing in different directions, a) Environmental forcing that 
is similar to environments experienced during evolution (i.e. toward E 2 , see thumbnail pictogram), b) 
Environmental forcing that is not similar to environments experienced during evolution (i.e. toward an 
arbitrary pattern, see thumbnail pictogram). 
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Figure 10: ‘Bestiary’ of ecological attractors changing over evolutionary time. From an array of dif¬ 
ferent random initial species densities (left-most column), the ecological states reached in the population 
dynamics changes over evolutionary time, a) Initially, all initial conditions lead to the same ecological 
attractor (with all species at the same carrying capacity), b) New attractor states begin to appear and 
become established, c) In the long term, the two-attractor state is unstable and positive feedback causes 
one of the attractor states to ‘out-compete’ the other, d) Eventually the one remaining attractor breaks 
down as only the strongest species (those that were high density in both patterns) take over |[65l . 
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Appendix f: Development and breakdown of multiple attractors over long 
evolutionary timescales. 

Fig. [T^ shows how the attractors of the ecosystem change over evolutionary time in Experi¬ 
ment 2. Interestingly, we see that in the long term the two-attractor state is unstable because, 
rather than reinforcing the ecological patterns that are ‘forced’ by the external environment, the 
system begins to reinforce its own patterns of behaviour ll58ll . and positive feedback causes one 
(slightly stronger) attractor to outcompete the other (Fig. [TT]). 



evolutionary time 


Figure 11: In the long term the two-attractor system breaks down. Monte Carlo sampling of the 
ecological attractor states from random initial species densities during evolutionary time. Initially, all 
attractor states contain species densities that are only minor deviations from the default attractor (Eq) in 
Euclidean distance. The signed pattern of the attractor state, i.e. in terms of +/— with respect to the 
mean species densities, either matches Ei (blue) or E 2 (green). As the two-attractor state emerges, at 
around generation 525 (a classic pitchfork bifurcation, but the unstable fixed point is not shown), the 
magnitudes (as well as signs) of the attractor states closely match the two targets. In the long term, one 
of the attractors, in this case Ei, outcompetes the other and becomes the only attractor. Eventually (after 
^575 generations), this attractor also degrades, i.e. the equilibrium magnitudes no longer match the 
original target closely (Fig. [TO]). 


Appendix g: Empirical tests for distributed learning in ecosystems 

The dynamical behaviours we observe in the evolved ecosystem are consistent with ecological 
memory, alternate ecological states, succession dynamics, assembly rules, regime changes and 
founder effects observed in natural ecosystems. These behaviours follow from simple com¬ 
ponent principles (i.e. the availability of heritable variation in inter-specific interactions, and 
the presence of ecological constraints or evolutionary trade-offs) and direct evidence for these 
behaviours is testable. For example, consider the evolution of a small microbial community. 
Given a culturable community with stable coexistence dynamics, we could first test whether it 
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has i) one or ii) alternative stable states. This requires sampling many different initial species 
compositions and allowing species densities to equilibrate, i) If a single state, we can then force 
the system into a different state (‘alternate ecosystem state’, ifTTll l e.g. by changing temper¬ 
ature, nutrient influx and hold it there for evolutionary time. Then remove the forcing and 
retest for multiple attractors (‘alternate community states’). If a memory has been conditioned 
by this forcing then a new attractor will be exhibited, ii) If the system initially has more than 
one attractor state, then we can estimate the basin size for each attractor by counting the num¬ 
ber of different initial conditions that arrive at one or the other. By leaving the system in one 
attractor over evolutionary time this should increase the relative basin size in proportion to the 
time spent in that attractor. Next we need to assess the extent to which such a memory is col¬ 
lective or merely the sum of individual memories. This can be done by swapping-in evolved 
species for species in the original community one-by-one and assessing the relative contribution 
of individual and collective genetic changes on the dynamical behaviour of the system. 

Appendix h: Asymmetric interactions, the importance of normalising eco¬ 
logical constraints, and other future work 

One important aspect of evo-eco dynamics that is highlighted by this model is the importance of 
normalising ecological constraints or evolutionary trade-offs for collective behaviours. These 
constraints prevent a species A from benefiting from the presence of species B without also 
becoming dependent on B. That is, it is not just the case that A grows faster in the presence of B, 
but that A’s growth is slower when B is absent. Under these conditions, changes to interactions 
do not merely increase the growth of each species in a manner that is sensitive to its ecological 
context, but more speciflcally, they modify correlations between species densities. We assume 
in the present model that an adaptation that, for example, decreases the niche overlap with 
one species increasing the niche overlap with others. But the extent to which species evolve 
dependencies rather than just (context-sensitive) individual advantages in natural ecosystems is 
an empirical matter and from this work we recognise it as a matter that is centrally important to 
the possibility of collective behaviours that are more than the sum of the individual behaviours. 

This paper has investigated only competitive interactions and has not investigated mutualis- 
tic interactions or asymmetric interactions such as characteristic of trophic, e.g. predator-prey, 
relationships. The observation that selected changes to interactions are Hebbian does not de¬ 
pend on them being symmetric (or competitive). That is, Eq. 3 is not sensitive to any assump¬ 
tions about the initial values of interaction coefficients, e.g., whether uiij and ojji are equal or 
even have the same sign, and therefore applies to predator-prey relationships as well as sym¬ 
metric competitive interactions. Eq. 3 also shows that the selective pressures on changes to 
interactions are symmetric i.e., AtCjj = (except for the influence of individually-varying 
carrying capacities), so there is no systematic reason for interactions to become asymmetric 
over evolutionary time. In the examples investigated in this paper the interaction coefficients 
are initialised symmetrically and, accordingly, they remain approximately symmetric. The evo¬ 
lutionary model could be applied to asymmetric interactions, but asymmetric interactions intro- 
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duce the possibility of non-fixed point attractors, e.g. cycles, that complicate the behaviour of 
the eco-evolutionary dynamics and their measurement considerably. (We note that where ujij 
and ujji differ, the addition of multiple symmetric changes through natural selection will make 
them less asymmetric over evolutionary time, i.e., bring the ratio of these terms closer to 1, and 
could evolve them to take the same sign even when they started out with opposite signs. This 
implies that the effect of evolutionary change would be to increase the stability of the ecological 
dynamics and reduce or remove chaotic or cyclic attractors over time). 

We have assumed that each interaction coefficient is independently modifiable whereas in 
natural populations traits may affect many interactions simultaneously. Here we chose to in¬ 
vestigate scenarios where none of the interaction coefficients reach zero or go positive (which 
is possible in principle despite the normalisation employed). The equations used exhibit unsta¬ 
ble behaviour in this case and a different approach to modelling would be required to handle 
mutualistic interactions. In natural populations one member of a population can gain selective 
advantage by changing its relationship to other members of its own species, but our simulations 
have fixed self-interactions at -1 and have investigated only the evolution of interactions with 
members of other species. 

A key technical distinction between the recent work on associative memory in gene net¬ 
works Il67ll and the models utilised here is that the Lotka-Volterra equations represent unsigned 
(positive) state variables, as is natural for species densities, rather than signed (positive and neg¬ 
ative) state variables representing under- or over- expressed gene activity (compared to some 
normal level). Although it is possible and common to model interesting dynamical behaviours 
using either signed or unsigned state variables in neural networks, the use of unsigned variables 
means that Hebb’s rule, or natural selection, will only alter interactions in one direction, i.e., 
the product XiXj is always positive (although crucially it may have different magnitudes). The 
assumption of normalising constraints that cause some interactions to become more competitive 
as a side effect of others becoming less competitive is thus important to the results that we have 
shown. 

In particular, the assumption of these normalising constraints means that changes to inter¬ 
actions, although motivated by increases in individual growth rates, have the effect of (also) 
altering the dependency of one species on another. That is, an individual cannot evolve in a 
manner that avoids competition with one species, x, without also making their growth more 
dependent on the presence of some other species, y. Without these constraints, the effect of 
unconstrained changes to interactions is to make high density species fitter in all conditions, 
rather than making them dependent on the simultaneous high density state of specific species 
(and hence less fit in some conditions). It is therefore important for future work to investigate 
how different ways of modelling such constraints impact the behaviours illustrated here. For ex¬ 
ample, rather than a Lotka-Volterra model, a stoichiometric model of species interactions may 
alleviate the need for an explicit normalisation mechanism. 

Assuming that ecological dynamics (i.e., changes in species density) are much more rapid 
than evolutionary changes (i.e., genetic changes affecting the coefficients of inter-species fitness 
dependencies) ll92ll . most evolution occurs whilst ecological dynamics are at or near equilib- 
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rium, as modelled here. The behaviour of evo-eco dynamics when these processes have more 
similar timescales OSll deserves attention. However, the fact that we model varying ecological 
conditions, causing the ecosystem to visit more than one ecological equilibrium, means that the 
interaction of ecological and evolutionary dynamics is non-trivial even though their timescales 
are kept separate in our simulations (following ll2^ 1. Moreover, any model assuming a sin¬ 
gle ecological attractor will overlook the interesting behaviours modelled here, regardless of 
whether the timescales are separated or similar. 
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